The Automorphism Group of a 
Domain with an Exponentially 
Flat Boundary Pointtr 



Abstract: We study the automorphisms group action on a bounded 
domain in C" having a boundary point that is exponentially Hat. 
Such a domain typically has a compact automorphism group. Our 
results enable us to generate many new examples. 



Introduction 

A domain Q in C" is a connected, open set. An automorphism of fi is a bi- 
holomorphic self-map. The collection of automorphisms forms a group under 
the binary operation of composition of mappings. The topology on this group 
is uniform convergence on compact sets, or the compact-open topology. We 
denote the automorphism group by Aut(fi). 

Although domains with transitive automorphism group are of some interest, 
they are relatively rare (see [HEL]). A geometrically more natural condition to 
consider, and one that gives rise to a more robust and broader class of domains, 
is that of having non- compact automorphism group. Clearly a domain has non- 
compact automorphism group if there are automorphisms which have no 
subsequence that converges to an automorphism. The following proposition of 
Henri Cartan is of particular utility in the study of these domains: 

Proposition 0.1 Let f2BC n be a bounded domain. Then ft has non-compact 
automorphism group if and only if there are a point X £ fi, a point P e dft, 
and automorphisms (pj of such that tfj(X) — > P as j — > oo. 
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We refer the reader to [NAR] for discussion and proof of Cartan's result. 
A point P in dfl is called a boundary orbit accumulation point if there is an 
X e f2 and automorphisms <pj of such that lim^oo <fij(X) = P. 
In the paper [GRK1], we considered the domain 

^oo = {(zi,z 2 ) € C 2 : \ Zl \ 2 + 2cxp(-l/|z 2 | 2 ) < 1} . (*) 

We showed that this domain has compact automorphism group. In particular, 
the only automorphisms (i.e., biholomorphic self-maps) of are the rotations 
in each variable separately. We note that, unlike the domains 

n m = {(z 1 ,z 2 );\z 1 \ 2 + \z 2 \ 2m < 1},to= 1,2,..., 

which have all points of the form (e lS , 0) as boundary orbit accumulation points, 
ttoo has no boundary orbit accumulation points. 

An example such as this bears directly on the Greene-Krantz conjecture: 

Conjecture: Let f26C™ be a smoothly bounded domain. If P is 
a boundary orbit accumulation point, then P must be a point of 
finite type in the sense of Kohn/Catlin/D'Angelo (see [KRAI] for 
this concept). 

This conjecture is not known to be true in its full generality. But evidence 
for its correctness is provided, for instance, in [KIM] and [KIK]. 

The domain ft oo in (*) can be analyzed like this: If there is an A G floo 
and a P = (pi,p2) € d^loo with p 2 ^ so that lirn 7 _ ) . 00 ipj(X) = P for some 
automorphisms ipj , then P is strongly pseudoconvex. The theorem of Bun Wong 
and Rosay (see [WON], [ROS]) then tells us that fioo must be biholomorphic to 
the ball. But a result of Bell/Boas [BEB] tells us that such a biholomorphism 
must extend smoothly to the boundary. That is impossible, since i^oo has a 
circle {(e l0 ,O)} of weakly pseudoconvex points in the boundary while the ball 
B is strongly pseudoconvex. If instead p 2 = 0, then a delicate analysis — see the 
proof of Proposition 1.3 below — shows that it is impossible for an orbit {ipj(X)} 
to accumulate at P. Thus we conclude, using Proposition 0.1, that Aut(Qoo) 
must be compact. 

Of course the boundary points (e t9 , 0) of the domain fioo in (*) are of infinite 
type. It is important to have examples like this at hand to aid in the study of 
the Greene-Krantz conjecture. 

The purpose of this paper is to provide a good many further examples of 
such domains. We provide domains with different types of geometry in different 
dimensions. All have compact automorphisms group. 

In general it is quite difficult to produce examples of any kind in the study 
of automorphism groups of domains in C™. The techniques presented in this 
paper may prove useful in other contexts. 
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1 Some Principal Results 



The following simple technical result will be useful. I thank John P. D'Angelo 
for helpful discussions of the idea. 

Lemma 1.1 Let F be a holomorphic function on the unit ball B in C n , n > 2, 
which extends continuously to B. Assume that \F\ on dB equals a positive 
constant c. Then F is identically constant. 

Proof: Let P be a boundary point of the ball. Let d be an analytic disc whose 
image lies in a complex line which intersects dB transversally. Also suppose 
that the boundary circle of this analytic disc lies in dB — in other words, the 
analytic disc is just a complex line intersected with B. Assume that d is very 
close to P. Then |F| restricted to d will assume values that are uniformly very 
close to c. But |F| restricted to d is a function of one complex variable that 
satisfies the hypotheses of the lemma. So F restricted to d must be a finite 
Blaschkc product with values which in modulus are very close to c. It follows 
that F can have no zeros, so F restricted to d must be a constant. Since this 
statement must hold on all such analytic discs closed to P, we may conclude 
that F is constant. □ 



Remark 1.2 In point of fact, this lemma is true on any smoothly bounded 
domain. For such a domain will alway have a relatively open boundary neigh- 
borhood that is strongly convex. And the argument just presented will be valid 
on that neighborhood. 

Proposition 1.3 Consider the domain 

h = {z=(z 1 ,z 2 ,...,z n )eC n : N 2 + M 2 + --- + |z„-i| 2 +^(|z„|) < 1}, 

where 4> is a real-valued, even, smooth, monotone- and-convex-on-[0 , oo) function 
of a real variable with ip(0) = that vanishes to infinite order at 0. Then there 
do not exist a point X e f2 and automorphisms ifj of 17 so that lim^oo ipj (X) = 
(1,0,..., 0) e dh. 

Remark 1.4 Observe that points ( of dfl with ( n ^ are strongly pseudo- 
convex (as a calculation shows). Such a point cannot be an orbit accumulation 
point because then, by the Bun Wong/Rosay theorem, the domain would have 
to be biholomorpic to the unit ball. 

By contrast, the boundary points of the form (e l9 , 0, . . . , 0), (0, e %8 , 0, . . . , 0), 
. . . , (0,0,..., e t6 , 0) are of infinite type. We state a result for the particular 
boundary point (1, 0,0,..., 0), but in fact the analysis applies to any boundary 
point of the form (e lt> , 0, 0, . . . , 0), (0, e 10 , 0, . . . , 0),'. . . , (0, 0, . . . , e l0 \ 0),0 < 6 < 
2tt. 

Of course an example of a real function ip as in the statement of the theorem 
is X(t) = 2exp(-l/£ 2 ). 



3 



Proof of Proposition 1.3: Seeking a contradiction, let us suppose that there 
is a point X € 51 and a sequence of automorphisms ipj such that <fj(X) — > 

(1,0,..., o) e an. 

The set of weakly pseudoconvex points in the boundary is 

S = {z e dQ : z n = 0} . 

All other boundary points are strongly pseudoconvex. Since the work of Bell/Boas 
[BEB] tells us that automorphisms extend smoothly to the boundary, we may 
conclude that any automorphism <p will preserve S. Thus it will also preserve 
the ball 

n-1 

e = {(z 1 ,z 2 ,...,z n - 1 ,0) : \zj\ 2 < 1}. 

i=i 

We see then that the restriction of ip to e will be an automorphism of the 
unit ball in C™ _1 . After composing each <pj with rotations in the z\, z 2 , • ■ • , 
z n -i variables, we may take it that 

ipj(zi,Z2,Z 3 ...,Z n --L,0) = 



Zl -a) V^K 2 ' 222 V 1 ~ |a ? |2z3 ^/I-IS"" 1 ! 2 ^-! 



l-a)z± l-a 2 zi ' l-afzi '"' l-a"" 1 ^ 







for some € C, |aj| < 1, ^ = 1, . . . , n — 1. By imitating the proof of the 
classical result (see [KRAI]) about automorphisms of circular domains, we may 
see that each ipj commutes with rotations in the z n variable. It follows that 
each ipj preserves every disc of the form 

f Q ^{>,C):M 2 + V(|CI)<l}, 

for some fixed a € C™ -1 with \a\ < 1. Of course here ( e C. By rotational 
invariance, the image of f Q under ipj must be a disc of the form 

V>j(fa) = {(^(«,0),C) : k J -(a,0)| 2 + ^(|C|) < 1}. 

Furthermore, ipj sends the center of i a to the center of the image disc. We 
conclude then that ipj must have the form 

{zi,Z2,Z3,...,Z n ) i — > 



-I ' i —2 i ■■■ i — i i z n ' \{ z lt ■ ■ ■ ■> z n-l) 

(XaZ\ 1 — s-zi 1 - a jZ i 1 - a - z\ 



for Xj holomorphic. 
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Thus we see that 
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+ ^(z„ • X j (z 1 ,...,Z n - 1 )) < 1. (f) 



This may be rewritten as 

\ z ' n \ ^ T\ 7 \T 
|Aj(£l,22, • • • , Z n -l)\ 



■V" 1 1 



1 - |a?| 2 *2 



1 - a 2 2i 



2i 



|a|| 2 « 3 



But we also know that 

\z n \ < -0- 1 (1 — |^i| 2 
The only possible conclusion is that 



2 |2~j 



— 22 - • • • - |^„_ 1 
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^/l-la^- 1 !^ 



1— a . 



^-l(l-|^|2_| 02 |2 



= |Aj(zi,2 2 , • • • ,2„_l)| • (*) 

Now we let |(zi, 2 2 , . . . , z n -i)| — > 1- Since i/; -1 vanishes to infinite order, but 
the two arguments of i/> -1 vanish to finite order, we can only conclude that the 
lcfthand side of (*) tends to some positive constant 7. Hence 



I Xj (21,22, 



,2„_i| = 7 



on the boundary of the unit ball in (n — l)-dimensional complex space. By 
our lemma, we conclude that A is a constant^ function. It follows that the map- 
pings <fj cannot exist (as automorphisms of ft). Hence our proof is complete. □ 



Remark 1.5 In fact the proposition shows that there are uncountably many 
biholomorphically distinct domains that satisfy the conclusion of the assertion. 
For one has great freedom in selecting the function ip, and the theory of the 
Chern-Moser invariants establishes the biholomorphic distinctness for the dif- 
ferent choices. 
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Next we have: 
Proposition 1.6 Consider the domain 

ti = {z = (z u z 2 ,...,z n )eC n : |zi| 2mi + |z 2 | 2m2 + ...+|z„_ 1 | 2m "- 1 +^(|z„|) < 1} , 

where the rrij are positive integers and where ip is a real-valued, even, smooth, 
monotone-and-convex-on-[0, oo) function of a real variable with ip(0) = that 

vanishes to infinite order at 0. Then ft has compact automorphism group. 

Proof: If all the the rrij are greater than 1 then it is easy to calculate that all 
of the circles 

{{e w , 0, . . . , 0) : < 9 < 2tt} , {(0, e w , 0, . . . , 0) : < 9 < 2tt} , ... , 

{(0,0,...,0,e 4e ) : < 9 < 2tt} 

consist of weakly pseudoconvex points. In fact points on any of those circles 
have (n— 1) weakly pseudoconvex directions. The boundary points with all coor- 
dinates nonvanishing are strongly pseudoconvex. Thus points of the latter type 
form a relatively open and dense set in the boundary. One may argue that, if 

the automorphism group were noncompact and there were a point XeS] and a 

point P e 9f2 with fj(X) — > P for some automorphisms ipj, then at least one of 
these circles would be moved towards P by the ipj. As a result, weakly pseudo- 
convex boundary points would be mapped to strongly pseudoconvex boundary 
points. And that is impossible. 

So the only case of interest is that where at least one of the rrij is equal to 
1. Say for specificity that m\ = 1. In that case points of the form (e ld , 0, . . . , 0) 
have (n — 1) weakly pseudoconvex directions, whereas points on the other indi- 
cated circles have one weakly pseudoconvex direction. As before, points with all 
coordinates nonvanishing are strongly pseudoconvex. So we can argue as above 
to see that the automorphism group must be compact. □ 

Another type of domain that we may consider is described in the next propo- 
sition: 

Proposition 1.7 Consider a domain of the form 

Q' = {{ Zl ,Z2,...,z n ) £C" : |zi| 2 + 2cxp(-l/(|z 2 | 2 + --- + |z„| 2 )} < 1. 
Then £1' must have compact automorphism group. 

Proof: As usual, points with z 2 7^ 0,z 3 ^ 0, . . . , z n ^ are strongly pseudo- 
convex. By the Bun Wong/Rosay theorem, they cannot be orbit accumulation 
points. 
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If a point of the form (e lfl , 0, . . . , 0) is an orbit accumulation point, then we 
may argue as in the proof of the first proposition. The main difference is that 
line (f) is replaced by 

2 

+ p(z 2 , z 3 ,...,z n ) ■ Aj(zi) < 1, 

where p is a unitary rotation in (n — 1) variables. The argument is now com- 
pleted as before. □ 



z i - a j 
1 — cijZi 



2 Concluding Remarks 

There is no Riemann mapping theorem in several complex variables. Thus we 
seek other means of contrasting and comparing domains in C". The automor- 
phism group and its associated features have proved to be powerful and flexible 
invariants in this study. Certainly the Levi geometry of boundary orbit accu- 
mulation points has been studied extensively ([GRK2] and [ISK]). The results 
of this paper fit into that program. 

We hope to continue these studies in future papers. 
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